Parallel programming - techniques and applications using networked workstations and parallel computers (2. ed.)

Processes Barrier Figure 6.1 Processes reaching the barrier at different times. Time Active Waiting Synchronous Computations In a (fully) synchronous application, all the processes are synchronized at regular points. A barrier, a basic mechanism for synchronizing processes-inserted at the point in each process where it must wait. All processes can continue from this point when all the processes have reached it (or, in some implementations, when a stated number of processes have reached this point).